Electronic device and operating method thereof

ABSTRACT

An electronic device is provided. The electronic device includes a camera, a display, a processor electrically coupled with the camera and the display, and a memory electrically coupled with the processor. The memory is configured to store instructions which, when executed, instruct the processor to, when a photographing request signal is received, estimate a motion of a subject within an image that is acquired by the camera, when the motion of the subject within the image acquired by the camera is not recognized, control the camera to capture a first type image by applying a first photographing condition, and when the motion of the subject within the image acquired by the camera is recognized, control the camera to capture a second type image by applying a second photographing condition.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation application of prior application Ser.No. 17/368,157, filed Jul. 6, 2021, which application is a continuationapplication of prior application Ser. No. 16/895,568, filed Jun. 8,2020, and has issued as U.S. Pat. No. 11,089,206 on Aug. 10, 2021, whichis a continuation application of prior application Ser. No. 15/471,608filed on Mar. 28, 2017, and has issued as U.S. Pat. No. 10,681,263 onJun. 9, 2020, which is based on and claimed the benefit under 35 U.S.C.§ 119(a) of a Korean patent application number 10-2016-0040318, filed onApr. 1, 2016, in the Korean Intellectual Property Office, the disclosureof which is incorporated by reference herein in its entirety.

TECHNICAL FIELD

The present disclosure relates to an electronic device capable ofcapturing an image, and an operation thereof.

BACKGROUND

Recently, with the growth of digital technologies, various types ofelectronic devices are being widely used, such as mobile communicationterminals, smart phones, tablet personal computers (PCs), personaldigital assistants (PDAs), electronic organizers, notebook computers,wearable devices, etc. The electronic devices have reached a mobileconvergence stage that puts together even functions of other devices.

The electronic device can be an imaging device having image sensors. Theimaging device can acquire an image by a user's selection.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

The electronic device stated above may acquire an image in variousmethods.

An image acquisition method could capture an image by a user'sselection. However, if a subject moves, a user of the electronic devicemay find it difficult to photograph a natural action of the subject. Forexample, if the subject takes an unexpected motion, the user may find itdifficult to photograph the subject when it performs the correspondingmotion.

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide an electronic device and an operating methodthereof, capable of photographing an image based on a user's selectionand a photographing state recognition of the device.

Another aspect of the present disclosure is to provide an electronicdevice and an operating method thereof, capable of photographing animage based on a user's selection and a motion of a subject.

Another aspect of the present disclosure is to provide an electronicdevice and an operating method thereof, capable of photographing animage based on a user's selection, a motion of a subject, and a motionof the device.

Another aspect of the present disclosure is to provide an electronicdevice and an operating method thereof, capable of photographing animage based on a user's selection, a motion of a subject, a motion ofthe device, an emotion change of a subject (e.g., person), etc.

In accordance with an aspect of the present disclosure, an electronicdevice is provided. The electronic device includes a camera, a display,a processor electrically coupled with the camera and the display, and amemory electrically coupled with the processor. The memory is configuredto store instructions which, when executed, instruct the processor to,when a photographing request signal is received, estimate a motion of asubject within an image that is acquired by the camera, when the motionof the subject within the image acquired by the camera is notrecognized, control the camera to capture a 1^(st) type image byapplying a 1^(st) photographing condition, and when the motion of thesubject within the image acquired by the camera is recognized, controlthe camera to capture a 2^(nd) type image by applying a 2^(nd)photographing condition.

In accordance with another aspect of the present i disclosure, a methodof an electronic device is provided. The method includes, when aphotographing request signal is received, estimating a motion of asubject within an image that is acquired by a camera, when the motion ofthe subject within the image acquired by the camera is not recognized,controlling the camera to capture a 1^(st) type image by applying a1^(st) photographing condition, and when the motion of the subjectwithin the image acquired by the camera is recognized, controlling thecamera to capture a 2^(nd) type image by applying a 2^(nd) photographingcondition.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a diagram illustrating a construction of an electronic deviceaccording to an embodiment of the present disclosure;

FIG. 2 is a diagram illustrating a construction of a camera moduleaccording to an embodiment of the present disclosure;

FIG. 3 is a diagram illustrating a construction of a device capturing animage in an electronic device according to an embodiment of the presentdisclosure;

FIGS. 4A, 4B, and 4C are diagrams illustrating a display example of whena user-device photographing mode is executed in an electronic deviceaccording to various embodiments of the present disclosure;

FIGS. 5A, 5B, 5C, 5D, 5E, and 5F are diagrams illustrating a screendisplay with a single display in an electronic device according tovarious embodiments of the present disclosure;

FIGS. 6A and 6B are diagrams illustrating a screen display example of adual display in an electronic device according to various embodiments ofthe present disclosure;

FIG. 7 is a diagram illustrating another construction of a deviceacquiring an image in an electronic device according to an embodiment ofthe present disclosure;

FIG. 8 is a flowchart illustrating an operation of photographing animage in an electronic device according to an embodiment of the presentdisclosure;

FIG. 9 is a flowchart illustrating an operation of processing a capturedimage in an electronic device according to an embodiment of the presentdisclosure;

FIG. 10 is a flowchart illustrating an operation of displaying aphotographed image in an electronic device according to an embodiment ofthe present disclosure;

FIG. 11 is a flowchart illustrating an operation of photographing animage in an electronic device according to an embodiment of the presentdisclosure; and

FIG. 12 is a flowchart illustrating an operation of photographing animage in an electronic device according to an embodiment of the presentdisclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purposes only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

An electronic device according to various embodiments of the presentdisclosure may, for example, include at least one of a smart phone, atablet personal computer (PC), a mobile phone, a video phone, anelectronic book (e-book) reader, a desktop PC, a laptop PC, a netbookcomputer, a workstation, a server, a personal digital assistant (PDA), aportable multimedia player (PMP), a moving picture experts group (MPEG-1or MPEG-2) audio layer 3 (MP3) player, a mobile medical device, acamera, or a wearable device.

An electronic device according to various embodiments is described belowwith reference to the accompanying drawings. In the present document,the term ‘user’ may denote a person who uses the electronic device or adevice (e.g., artificial-intelligent electronic device) which uses theelectronic device. In various embodiments of the present disclosure, theelectronic device includes an image sensor, and may be an imaging devicecapable of acquiring an image through the image sensor.

FIG. 1 is a diagram illustrating a construction of an electronic deviceaccording to an embodiment of the present disclosure.

Referring to FIG. 1 , an electronic device 10 may include a processor100, a memory 110, a camera module 120, a sensor module 130, an inputmodule 140, and/or a display 150. In an embodiment, the electronicdevice 10 may omit at least one of the constituent elements oradditionally have another constituent element.

The processor 100 may include one or more of a central processing unit(CPU), an application processor (AP), or a communication processor (CP).The processor 100 may, for example, execute operation or data processingaccording to control and/or application execution of at least oneanother constituent element of the electronic device 10.

The processor 100 according to various embodiments of the presentdisclosure may include an image signal processor (ISP), a subject motionestimating module, a device motion detecting module, an emotionrecognizing module, an image controlling module, a display processingmodule, etc. In various embodiments of the present disclosure, theprocessor 100 may execute a photographing application that acquires animage. The electronic device 10 according to various embodiments of thepresent disclosure may execute an application (hereinafter, referred toas a ‘user-device photographing application’) that is capable ofphotographing an image by a user and/or the electronic device 10.

In an embodiment, if the user-device photographing application isexecuted, the processor 100 may estimate a motion of a subject within animage. The processor 100 may execute a function of capturing an imagebased on a user's selection and/or the motion of the subject.

In an embodiment, the processor 100 may estimate a motion of a subjectwithin an image, and may detect a motion of the electronic device 10.The processor 100 may set, as a photographing condition, a state inwhich the motion of the subject is detected and/or a state in which themotion of the electronic device 10 is detected. The processor 100 mayexecute a function of capturing an image based on a user's selection orthe set photographing condition.

In an embodiment, the processor 100 may estimate a motion of a subjectwithin an image, and may detect a motion of the electronic device 10,and may recognize the emotion of a subject (e.g., person) within theimage. The processor 100 may set, as a photographing condition, a statein which the motion of the subject is recognized, or the motion of theelectronic device 10 is detected, or an emotion change of the subject isrecognized. The processor 100 may execute a function of capturing animage based on a user's selection or the set photographing condition.

The memory 110 may include a volatile and/or non-volatile memory. Thememory 110 may store a command or data related to at least one anotherconstituent element of the electronic device. The memory 110 may store asoftware and/or program. The program may, for example, include a kernel,a middleware, an application programming interface (API), an applicationprogram (or “application”), etc. At least some of the kernel, themiddleware, or the API may be called an operating system (OS). Thememory 110 according to various embodiments of the present disclosuremay store a software and/or program for performing the user-devicephotographing application, and may include a memory (or buffer) thatbuffers and stores captured images.

The sensor module 130 may meter a physical quantity and sense anactivation state of the electronic device 10, and convert metered orsensed information into an electrical signal. The sensor module 130 mayinclude an acceleration sensor and/or a gyro sensor that are capable ofsensing a motion of the electronic device 10. The acceleration sensormay sense a horizontal and/or vertical movement of the electronic device10, and the gyro sensor may sense the rotation movement of theelectronic device 10.

The sensor module 130 may further include at least one of a gesturesensor, a barometer, a magnetic sensor, a grip sensor, a proximitysensor, a color sensor (e.g., a red, green, blue (RGB) sensor), amedical sensor, a temperature-humidity sensor, an illuminance sensor, aultraviolet (UV) sensor, or a flexibility sensing sensor sensing thebending of the electronic device 10.

Additionally or alternatively, the sensor module 130 may further includea control circuit for controlling at least one or more sensors belongingtherein. In some embodiments, the electronic device 10 may furtherinclude a processor (e.g., low power processor) configured to controlthe sensor module 130 as a part of or apart from the processor 100, sothe electronic device 10 may control the sensor module 130 while theprocessor 100 is in a sleep state.

The camera module 120 is, for example, a device able to take a stillpicture and a moving picture. According to an embodiment, the cameramodule 120 may include one or more image sensors (e.g., a charge coupleddevice (CCD) sensor and/or a complementary metal-oxide-semiconductor(CMOS) sensor), a lens unit, an image processing module (i.e., imagesignal processor (ISP)), or a flash (e.g., a light emitting diode (LED),a xenon lamp, etc.). The ISP may be included in the processor 100 aswell. In various embodiments of the present disclosure, a descriptionwill be made by way of an example in which the image processing module(i.e., ISP module) is included in the processor 100.

According to various embodiments of the present disclosure, the cameramodule 120 may photograph an image based on the control of the processor100. The camera module 120 may control a photographing interval timeand/or exposure time under the control of the processor 100.

The input module 140 may include at least one of a touch panel, a(digital) pen sensor, a key or ultrasonic input units. The touch panelmay employ (use) at least one scheme among a capacitive overlay scheme,a pressure sensitive scheme, an infrared beam scheme, or an ultrasonicscheme. Also, the touch panel may further include a control circuit aswell. The touch panel may further include a tactile layer to provide atactile response to a user. The touch panel according to variousembodiments of the present disclosure may include a pressure sensorfunction. The (digital) pen sensor may be a part of the touch panel orinclude a separate sheet for recognition. The key may include a physicalbutton, an optical key, or a keypad. The ultrasonic input unit may sensean ultrasonic wave generated in an input tool, through a microphone, andcheck data corresponding to the sensed ultrasonic wave.

The display 150 may include a liquid crystal display (LCD), a lightemitting diode (LED) display, an organic light emitting diode (OLED)display, a micro-electro-mechanical systems (MEMS) display, or anelectronic paper display. The display 150 may display various screens(e.g., a text, an image, a video, an icon, a symbol, etc.) for a user.

The input module 140 and the display 150 may be constructed as aone-piece touch screen. The touch screen may display a screen under thecontrol of the processor 100, and may detect a touch, gesture,proximity, or hovering input that uses an electronic pen or a part ofthe user's body.

The electronic device 10 may further include another module besides theconstruction of FIG. 1 . For example, the electronic device 10 may be amobile communication device (for example, a smart phone, etc.) thatfurther includes a communication module. The communication module mayinclude a wireless communication module and a wired communicationmodule. The wireless communication module may include a cellularcommunication module and a short-range communication module.

The cellular communication module may use at least one of long termevolution (LTE), LTE-advanced (LTE-A), code division multiple Access(CDMA), Wideband CDMA (WCDMA), universal mobile telecommunicationssystem (UMTS), wireless broadband (WiBro), global system for mobilecommunications (GSM), etc. The cellular communication module may, forexample, provide voice telephony, video telephony, a text service, anInternet service, etc., through a telecommunication network. Accordingto an embodiment, the cellular communication module may perform thedistinction and authentication of the electronic device 10 within atelecommunication network, using a subscriber identification module(e.g., subscriber identification module (SIM) card). According to anembodiment, the cellular communication module may perform at least somefunctions among functions that the processor 100 may provide. Accordingto an embodiment, the cellular communication module may include acommunication processor (CP).

The short-range communication module may include at least one of Wi-Fi,Bluetooth (BT), near field communication (NFC), magnetic securetransmission (MST), a global navigation satellite system (GNSS), aglobal positioning system (GPS), etc. The MST may use an electromagneticsignal, to generate a pulse in accordance with transmission data. Thepulse may generate a magnetic field signal. The electronic device 10 maytransmit the magnetic field signal to a point of sales (POS). Bydetecting the magnetic field signal through an MST reader and convertingthe detected magnetic field signal into an electrical signal, the POSmay restore data. In accordance with a use area, a bandwidth, etc., theGNSS may, for example, include at least one of a GPS, a Globalnavigation satellite system (Glonass), a Beidou navigation satellitesystem (hereinafter, “Beidou”), Galileo, or the European globalsatellite-based navigation system. Below, the “GPS” may be usedinterchangeably with the “GNSS.”

The wired communication module may, for example, include at least one ofa universal serial bus (USB), a high definition multimedia interface(HDMI), a recommended standard-232 (RS-232), a plain old telephoneservice (POTS), etc.

In various embodiments of the present disclosure described below, theelectronic device 10 may include an image sensor, and may be an imagingdevice capable of processing images acquired through the image sensor.For example, in various embodiments of the present disclosure, theelectronic device 10 may include all devices that make use of one ormore of various processors of an AP, a CP, a graphic processing unit(GPU), a central processing unit (CPU), etc., such as all informationcommunication equipments, multimedia equipments, wearable devices, andapplied equipments for these, which support functions according tovarious embodiments of the present disclosure.

In various embodiments of the present disclosure described below, ahardware access method is described as an example. However, the variousembodiments of the present disclosure include a technology using all ofhardware and software, so it is not that the various embodiments of thepresent disclosure exclude a software-based access method.

The electronic device 10 according to various embodiments of the presentdisclosure includes a camera module. The electronic device 10 maycontrol the camera module in accordance with a user's selection and/or astate of the electronic device 10 or a subject, to capture an image. Forexample, the electronic device 10 may capture an image by the user'sselection. Also, the electronic device 10 may automatically capture animage if a motion of a subject within the image is estimated or a motionof the electronic device 10 is detected or an emotion change of thesubject within the image is recognized.

FIG. 2 is a diagram illustrating a construction of a camera moduleaccording to an embodiment of the present disclosure. The camera module20 may be the camera module 120 of FIG. 1 .

Referring to FIG. 2 , the camera module 20 may include a timing controlunit 210, an image sensor 200, an actuator 250, and a lens unit 260. Theimage sensor 200 may include a row driver 220, a pixel array 230, and acolumn driver 240.

The lens unit 260 may perform an operation of imaging an external lightsignal. The actuator 250 may control the lens unit 260 under the controlof a processor. For example, the lens unit 260 may perform functions offocusing, tracking, and zooming-in/out based on the driving of theactuator 250.

The timing control unit 210 may control an operation timing of the imagesensor 200. The timing control unit 210 may generate a timing controlsignal for controlling the exposure and readout of the image sensor 200.The timing control unit 210 may be either located within the cameramodule 20, or may be constructed within the processor.

The row driver 220 may set an exposure time of the pixel array 230 bythe timing control unit 210. The pixel array 230 may generate, as pixelsignals, light signals that are imaged in the lens unit 260. Respectivepixels constructing the pixel array 230 may include micro lenses, colorfilters, and/or photo detectors. For example, a resolution (the numberof row pixels of the pixel array*the number of column pixels) of thepixel array 230 may be standard definition (SD) (720*480), highdefinition (HD) (1280*720), full HD (1920*1080), ultra high definition(UHD) (3840*2160), etc. The respective pixels of the pixel array 230 maygenerate, as pixel signals, signals that are imaged through the lensunit 260 during the exposure time, respectively. The exposure time maybe the time for which pixel sensors of the pixel array 230 receivelight.

The column driver 240 may read out column pixel signals of the pixelarray 230 by the control of the timing control unit 210. For example,the column driver 240 may select and read out line image signals insequence under the control of the timing control unit 210. The columndriver 240 may include an analog to digital converter (ADC). The ADC mayconvert a pixel signal outputted by the unit of line, into digital data.The column driver 240 may output the digital data converted in the ADC,in a mobile industry processor interface (MIPI) scheme.

The image sensor 200 may be driven in a driving method such as a globalshutter or rolling shutter scheme. The shutter may represent controllingthe exposure time of the pixel array 230 when an image is acquired. Theglobal shutter scheme may be a scheme of simultaneously conducting theexposure of row lines of the pixel array 230 and reading out pixelsignals of the pixel array 230 by the unit of line. The rolling shutterscheme may be a scheme of sequentially conducting the exposure of rowlines of the pixel array 230 and sequentially reading out pixel signalsof the row lines of which the exposure time expires. In an embodiment,the image sensor 200 may be driven in the rolling shutter scheme.

FIG. 3 is a diagram illustrating a construction of a device 30 capturingan image in an electronic device according to an embodiment of thepresent disclosure. For example, the construction of FIG. 3 may be afunction block construction. The function blocks may be programinstructions stored in the memory 110, and the processor 100 may controloperations of the function blocks.

Referring to FIG. 3 , an image processing module (i.e., ISP) 310 may bea module processing an image that is acquired in a camera module (forexample, the camera module 120 of FIG. 1 ). The image processing module310 may be included in the camera module as well. The image processingmodule 310 may include an image pre-processing unit, an imagepost-processing unit, an encoder, a decoder, etc.

The image pre-processing operation of the image processing module 310may perform auto white balance (AWB), auto exposure (AE), auto focusing(AF) extracting and processing, lens shading correction, dead pixelcorrection, knee correction, etc., for frame images (for example, pixelsizes of images corresponding to a resolution of the pixel array 230)that are acquired in the camera module.

The image post-processing operation of the image processing module 310may include a color interpolator, an image processing chain (IPC), acolor converter, etc. The image processing module 310 may perform acolor interpolation operation for image-pre-processed sub frame imagesthrough the color interpolator, and perform noise cancellation, colorcorrection, etc. for the color-interpolated sub frame images through theIPC, and convert RGB data into luminance-bandwidth-chrominance (YUV)data through the color converter. The image sensor may be a CCD or CMOSimage sensor. The CCD/CMOS image sensor uses a color filter array. Dueto this, each pixel sensor may have only one color among three colorsfor making a color image. The color interpolation operation may performa function of converting (i.e., full color converting) colors of pixelsoutputted from the image sensor (for example, the image sensor 200 ofFIG. 2 ) into colors including three colors: Red, Green, and Blue. Thecolor interpolator may perform a color interpolation function, using acorrelation between adjacent pixels. The IPC may perform noisereduction, gamma correction, luminance correction, etc. forcolor-interpolated images. And, the color converter may convertcorrected images (for example, raw data and/or Bayer data) into YUVimages. A post-processing operation of the image processing module 310may be an operation of, after performing the color interpolation, thenoise correction, etc. for the pre-processed images, converting theimages into YUV images.

The image processing module 310 may encode image-processed frame images.The image processing module 310 may scale an image (for example, a fullsize image of the pixel array 230) that is generated in the cameramodule, to generate a preview image (or a live view image). Also, basedon the processed image, the image processing module 310 may control (forexample, AF, AE, AWB, IPC, face detection, object tracking, etc.) thecamera module including the image sensor, and/or the image processingmodule 310.

An image storing module 340 may store, in a memory (for example, thememory 110 of FIG. 1 ), an image (for example, a captured image)processed in the image processing module 310. The image stored in thememory may be an encoded image or a non-encoded image.

A motion estimating module 320 may estimate a subject motion within animage that is outputted from the image processing module 310. Theestimating of the motion of the subject may be conducted in variousmethods. First, the method of estimating the subject motion within theimage may analyze continuous images to allocate a velocity vector toeach pixel or region, and sense a group of pixels or regions havingsimilar velocity vectors to estimate operation information about amoving subject. For example, the motion estimating module 320 may use amethod of extracting a velocity vector from a point-to-pointcorresponding relationship, a method of tracking a moving subject basedon features extracted from continuous 1^(st) image (for example, aprevious-frame image) and 2^(nd) image (for example, a current-frameimage), a method of tracking a moving subject by attempting matchingbetween candidate regions using region information, a method of trackinga moving subject by measuring an optical flow using a restrictioncondition that a velocity vector change of each pixel within an image isgentle, etc. Second, the method of estimating the subject motion withinthe image may estimate the motion of the subject by analyzing differenceimages that are formed by a difference of gray-values between adjacentimages. For example, the motion estimating module 320 may use a methodof isolating a standstill region and an action region using a differenceof gray-values between adjacent images, a method of merging adifferential operation result and an edge operation result to detectaction information of an object, a method of using a differentialoperation and an adaptive predictor, etc.

In an embodiment, the motion estimating module 320 of the electronicdevice may estimate a motion of a subject included in an image, based onan optical flow scheme.

An image controlling module 330 may perform a photographing mode that isselected by a user. The photographing mode may include a user-devicephotographing mode. The user-device photographing mode may represent aphotographing mode of, in response to a user's capture request,capturing an image generated in the camera module and, if a conditionthat is set in the electronic device is recognized, automaticallycapturing an image generated in the camera module. If the user-devicephotographing mode is selected, the image controlling module 330 maydrive the camera module, and may display a preview image generated inthe image processing module 310 on a display through a displayprocessing module 350. Also, the image controlling module 330 maydisplay, on the display, a photographing button by which a user maygenerate a capture signal in the user-device photographing mode.

If the user-device photographing mode is selected, the image controllingmodule 330 may analyze the motion estimating module 320 and an input ofthe photographing button. If the input of the photographing button isrecognized or a motion of a subject is detected in the motion estimatingmodule 320, the image controlling module 330 may enable the imagestoring module 340 to store in the memory an image processed in theimage processing module 310. Also, if the motion of the subject isdetected in the motion estimating module 320, the image controllingmodule 330 may control the camera module to change a photographinginterval time and/or an exposure time. In an embodiment, the imagecontrolling module 330 may set the photographing interval time of thecamera module faster and set the exposure time shorter. In anembodiment, if the motion of the subject is detected, the imagecontrolling module 330 may control to capture an image automatically.Also, when capturing the image based on the motion detection, the imagecontrolling module 330 may control to change the photographing intervaltime and/or exposure time of the camera module to be shorter and capturethe image within a fast time. The image controlling module 330 maycontrol the image storing module 340 to store the captured image in thememory.

The display processing module 350 may display a preview image and/orcaptured images on a display in the user-device photographing mode. Thedisplay processing module 350 may display in various forms in accordancewith the type of the display. For example, the display may be configuredas a single display or a multi-display (hereinafter, a dual display isdescribed as an example). If the display is the single display, thedisplay processing module 350 may display a preview image in accordancewith a user's selection, and may display the preview image and thumbnailimages of captured images together, and may display only the thumbnailimages of the captured images. If the display is the dual display, thedisplay processing module 350 may display thumbnail images of capturedimages on a 1^(st) display, and display a preview image on a 2^(nd)display.

When the display processing module 350 displays the captured images onthe display, the display processing module 350 may distinguish anddisplay an image manually captured by a user's selection and an imagecaptured by the automatic photographing of the electronic device. In anembodiment, the display processing module 350 may add and display anicon image on an image manually captured by a user's selection, and mayadd and display each mutually different image on each of images capturedby a user and the electronic device, and may add and display an iconimage on an image automatically captured by the electronic device.

According to an embodiment of the present disclosure, if a user'sphotographing request signal is recognized, the electronic device maycapture an image generated in the camera module and store the capturedimage in the memory. Also, if the electronic device recognizes that themotion estimating module 320 estimates a subject motion within an image,the electronic device may capture an image generated in the cameramodule and store the captured image in the memory.

The motion estimating module 320 may estimate a motion of a subject invarious methods. According to an embodiment, the motion estimatingmodule 320 may estimate the subject motion in an optical flow scheme.The optical flow may be said to be a distribution indicating how abrightness pattern has moved in an image. A motion estimating method ofthe optical flow scheme may be a method of estimating how subjects areseen in an image and how the subjects are moving. The optical flow maybe obtained using continuous images (for example, a previous-frame imageand a current-frame image). If the optical flow has been broken, thesubject may be a mutually different subject. A pixel movement (i.e.,motion) of an image is the same as a movement of a subject. If knowing amovement speed of the subject, one may know an optical flow of acorresponding pixel in the image as well.

The optical flow method may be a method of, by tracking to where pixelscorresponding to a subject within an image are moved in continuous imageframes, estimating a motion of the subject. For example, the opticalflow method, one of methods of estimating the motion through adifference between continuous two frames, may be a scheme of graduallychanging brightness, to express the vector direction and velocity of asubject motion generated in an image. The optical flow scheme mayextract pattern motion information from continuous 2-dimensional imagesand, particularly, may extract a complicated motion well.

For example, the motion estimating module 320 of the optical flow methodmay acquire continuous images, and pre-process the acquired images, andestimate a motion of a subject based on the pre-processed images. Themotion estimating module 320 may use continuous previous-frame (framen−1) and current-frame (frame n) images. The motion estimating module320 may pre-process a two-frame image into a gray image. In thepre-processing operation, the motion estimating module 320 may convertan RGB image into a gray scale image. The motion estimating module 320may estimate a motion based on the converted gray scale image (i.e., agray n−1 image and/or a gray n image). For example, the motionestimating module 320 may process a continuous-two-frame image in ahorn-schuck (HS) technique and/or an HS or combined local-global (CLG)technique, to obtain motion information (i.e., a motion vector). The CLGtechnique may be a method combining a method that is strong against anHS density flow field and a lucas-kanade (LK) noise.

If there is a motion of a subject within an image, the motion estimatingmodule 320 may detect the motion (i.e., a motion vector) of the subject.

If a motion vector is detected (i.e., if a motion of a subject isestimated) in the motion estimating module 320, the image controllingmodule 330 may automatically capture an image generated in the cameramodule. That the motion of the subject is detected may represent thatthe subject photographed through the camera module is moving. Accordingto an embodiment of the present disclosure, if the subject moves, theelectronic device may control the camera module to make a photographinginterval time fast during the time for which the subject moves, in orderto capture images according to a motion of the subject. For this, theimage controlling module 330 may control the image photographinginterval time and/or exposure time of the camera module. If the motionof the subject is detected, the image controlling module 330 may controlthe photographing interval time of the camera module fast, and maycontrol a timing control unit (for example, the timing control unit 210of FIG. 2 ) to generate a control signal for making short the exposuretime of an image sensor (for example, the image sensor 200 of FIG. 2 ).For example, if the motion of the subject is detected, the electronicdevice may, similarly to a burst photographing method, control thephotographing interval time of the camera module fast during the timefor which the motion of the subject is recognized.

While a subject moves, the electronic device may capture images fast.Due to this, the electronic device may capture images having the samemotion. The image controlling module 330 may analyze images that areautomatically photographed based on a motion of the subject, and storethe optimal number of images. For the sake of this, the imagecontrolling module 330 may analyze captured images, and group imageshaving similar motions. The image controlling module 330 may filter thegrouped images to select images. For example, the image controllingmodule 330 may eliminate blur images, too dark or bright images, and/orimages not including a part of a subject (for example, images in whichthe subject deviates from a camera angle) among the grouped images. Theimage controlling module 330 may select images in which motions are notrepeated among the filtered images. Also, the image controlling module330 may display the filtered images as suggestion images on a displaythrough the display processing module 350, and may store images that areselected by a user. When a screen of the display is refreshed, the imagecontrolling module 330 may store only the set number of images (forexample, one suggestion image) per image group through the image storingmodule 340, and eliminate the remnant from a buffer (for example, aninternal buffer or the processor 100 or a specific region of the memory110).

The display processing module 350 may display captured images on thedisplay based on the user-device photographing mode by the control ofthe image controlling module 330. The display processing module 350 maydisplay the captured images based on the type of the display (forexample, the single display or the dual display).

FIGS. 4A, 4B, and 4C are diagrams illustrating a display example of whena user-device photographing mode is executed in an electronic deviceaccording to various embodiments of the present disclosure.

Referring to FIGS. 4A, 4B, and 4C, if a user selects a photographingmode, the electronic device may, as illustrated in FIG. 4A, display amode type in which the electronic device can photograph. In FIG. 4A, anicon 410 may be an icon image for selecting a normal photographing mode(for example, photographing by a user's selection), and an icon 415 maybe an icon image for selecting a user-device photographing modeaccording to an embodiment of the present disclosure. If the userselects the icon 415 of FIG. 4A, the processor (for example, theprocessor 100 of FIG. 1 ) may recognize this and enable a camera module(for example, the camera module 120 of FIG. 1 ). As illustrated in FIG.4B, the processor may display a preview image 420 that is generated byprocessing an image generated in the camera module, on the display (forexample, the display 150 of FIG. 1 ). As illustrated in FIG. 4B, theprocessor may display a photographing button 425 in a partial area of ascreen in which the preview image 420 is displayed (for example, a lowerdisplay area of the preview image). If the photographing button 425 isselected, the processor may capture an image according to a user'sselection.

In a state in which the preview image 420 is displayed as in FIG. 4B, ifa motion of a subject is estimated, the processor may control aphotographing interval time of the camera module fast while continuouslyautomatically capturing images including a moving subject as in FIG. 4C.For example, if the motion of the subject is detected, the processor maychange a photographing speed (for example, available maximumphotographing interval time and minimum exposure time) of the cameramodule, and continuously capture images during the time for which themotion of the subject is detected. The processor may capture an image bythe same operation, even when detecting a motion of the electronicdevice and/or recognizing an emotion change of the subject besidesdetecting the motion of the subject.

FIGS. 5A, 5B, 5C, 5D, 5E, and 5F are diagrams illustrating a screendisplay example of a single display in an electronic device according tovarious embodiments of the present disclosure.

Referring to FIGS. 5A, 5B, 5C, 5E, and 5F, if a display is a singledisplay, the electronic device may, as in FIG. 5A, display a previewimage on the display (for example, the display 150 of FIG. 1 ) in adevice-user photographing mode. If a user generates a 1^(st) input 510in process of displaying the preview image as in FIG. 5A, the electronicdevice may, as in FIG. 5B, display the preview image in a 1^(st) area520 of the display, and display thumbnail images (for example, P1-P12 inFIG. 5B) of captured images in a 2^(nd) area 530. For example, the1^(st) input 510 may be a gesture input and may be a swipe input. FIG.5B illustrates an example in which the 1^(st) input 510 is a gestureinput that is swiped from an edge area of the display to a screendisplay area of the display. For example, the 2^(nd) area 530 displayingthumbnail images of images automatically captured by the electronicdevice may be the edge area of the display, and the 1^(st) area 520displaying the preview image may be the remnant area of the displayexcepting the 2^(nd) area 530.

If the user generates a 2^(nd) input 515, the electronic device may, asin FIG. 5C, display captured images as thumbnail images in the wholearea of the display. For example, the 2^(nd) input 515 may be a gestureinput and may be a swipe input. FIG. 5C illustrates an example of agesture input that is swiped from the 2^(nd) area 530 of the display tothe screen display area of the display in a state in which the thumbnailimages of the images automatically captured by the electronic device aredisplayed in the 2^(nd) area 530. In case where the electronic devicedisplays the captured thumbnail images in the whole area by the 2^(nd)input 515, the electronic device may display the latest thumbnail imagemanually captured by a user's selection in a 1^(st) specific area 540 ofthe display, and display the latest thumbnail image automaticallycaptured by a motion of a subject in a 2^(nd) specific area 550, and maydisplay thumbnail images (for example, P1-P20 in FIG. 5C) of imagescaptured by a user's selection and/or the electronic device in a 3^(rd)specific area 560 in a grid type.

At this time, the thumbnail images displayed as in FIG. 5C may be imagesmanually captured by a user's selection and images automaticallycaptured by a motion of a subject, etc. When the electronic devicedisplays captured images as thumbnail images, the electronic device maydistinguish and display the images manually captured by the user'sselection or the images automatically captured by the electronic device.In an embodiment, the electronic device may add and display icon imageson the images manually selected by a user, and may not display iconimages on the images automatically captured by the electronic device. Inan embodiment, the electronic device may add and display a 1^(st) iconimage on the image manually selected by the user, and may display a2^(nd) icon image distinguished from the 1^(st) icon image on the imageautomatically captured by the electronic device. In an embodiment, theelectronic device may add and display an icon image on the imageautomatically captured by the electronic device, and may not display anicon image on the image manually selected by the user. For example, FIG.5C illustrates an example of adding and displaying an icon image 545 onthe image manually captured by the user, and not displaying an iconimage on the image automatically captured by the electronic device.

If the user generates a 3^(rd) input 570, as in FIG. 5D, in a state ofdisplaying the captured image as the thumbnail image, the electronicdevice may, as in FIG. 5E, display a preview image in the 1^(st) area520, and display the thumbnail images of the captured images in the2^(nd) area 530. The 3^(rd) input 570 may be a swipe input that isconducted in the reverse direction of the 2^(nd) input 515. If a 4^(th)input 575 is generated in a state of displaying the preview image in the1^(st) area 520 and displaying the thumbnail images of the capturedimages in the 2^(nd) area 530, as in FIG. 5E, the electronic device maydisplay the preview image in the whole display as in FIG. 5F. The 4^(th)input 575 may be a swipe input that is conducted in the reversedirection of the 1^(st) input 510.

Also, if the electronic device detects a motion (for example, detects amotion of a subject, a motion of the device, an emotion change of thesubject, etc.) in a state of displaying the preview image as in FIG. 5Aor FIG. 5F, the electronic device may display that an image isautomatically captured by the electronic device. For example, theelectronic device may display a trajectory of the motion of the subjecton a screen of the display.

As in FIGS. 5A, 5B, 5C, 5D, 5E, and 5F, a photographing button 500 maybe displayed on the screen of the display 150 displaying an image. Ifthe user touches the photographing button 500, the electronic device mayrecognize that it is a user's selection, and capture an image generatedin the camera module. When the electronic device captures the image bythe user's selection, the electronic device may capture the image with aset photographing interval time and/or exposure time.

FIGS. 6A and 6B are diagrams illustrating a screen display example of adual display in an electronic device according to an embodiment of thepresent disclosure.

Referring to FIG. 6A, the electronic device may include a 1^(st) display610 and a 2^(nd) display 620. In case where a display is a dual displayhaving the 1^(st) display 610 and the 2^(nd) display 620, the electronicdevice may display a preview image on the 2^(nd) display 620, anddisplay thumbnail images of images captured by a user and the electronicdevice on the 1^(st) display 610. Also, a photographing button 625 forcapturing an image by a user's selection may be displayed on the 2^(nd)display 620.

The thumbnail images displayed on the 1^(st) display 610 may be imagesmanually captured by a user's selection and images automaticallycaptured by a motion of a subject, etc. In case where the electronicdevice displays the captured thumbnail images on the 1^(st) display 610,the electronic device may display the latest thumbnail image manuallycaptured by the user's selection in a 1^(st) specific area 630 of the1^(st) display 610, and display the latest thumbnail image automaticallycaptured by the motion of the subject in a 2^(nd) specific area 635.When the electronic device displays the captured images as the thumbnailimages, the electronic device may distinguish and display the imagesmanually captured by the user's selection or images automaticallycaptured by the electronic device. The thumbnail image displayed on the1^(st) display 610 of FIG. 6A illustrates an example of adding anddisplaying an icon image on an image manually captured by a user, andnot displaying an icon image on an image automatically captured by theelectronic device.

Referring to FIG. 6B, the electronic device may display screen 650 forsetting a user-device photographing mode. If a button (e.g., icon 415 ofFIG. 4A) for executing the user-device photographing mode is selected,the electronic device may, as in screen 660, display thumbnail images ofcaptured images on the 1^(st) display 610 and display, as a previewimage, an image outputted from the camera module on the 2^(nd) display620. The electronic device may display the latest image manuallycaptured by a user's selection in the 1^(st) specific area 630 of the1^(st) display 610, and display the latest image automaticallyphotographed by the electronic device in the 2^(nd) specific area 635,and may display thumbnail images captured by the user's selection and/orthe electronic device in the remnant area. If the user selects thethumbnail image as denoted by reference numeral 665 among the thumbnailimages displayed on the 1^(st) display 610, the electronic device maydisplay an image corresponding to the selected thumbnail image on the1^(st) display 610, as in screen 670. Also, if the user selects the1^(st) display 610, as denoted by reference numeral 675 in process ofdisplaying the selected captured image as in screen 670, the electronicdevice may display the captured thumbnail images on the 1^(st) display610 as in screen 680.

Also, if the electronic device detects a motion (i.e., a motion of asubject, a motion of the device, an emotion change of the subject, etc.)in a state of displaying the thumbnail images and the preview image, asin screen 660 and screen 680, the electronic device may display anoperation of automatically capturing an image by the electronic deviceon the 2^(nd) display 620 as well.

FIG. 7 is a diagram illustrating another construction of a device 70acquiring an image in an electronic device according to an embodiment ofthe present disclosure. For example, the construction of FIG. 7 may be afunction block construction. The function blocks may be programinstructions stored in a memory (for example, the memory 110 of FIG. 1), and operations of the function blocks may be controlled by aprocessor.

Referring to FIG. 7 , an image processing module (i.e., ISP) 710 may bea module processing an image that is acquired by a camera module (forexample, the camera module 120 of FIG. 1 ). The image processing module710 may be included in the camera module as well. The image processingmodule 710 may include an image pre-processing unit, an imagepost-processing unit, an encoder, a decoder, etc.

The image pre-processing unit of the image processing module 710 mayperform auto white balance (AWB), auto exposure (AE), auto focusing (AF)extracting and processing, lens shading correction, dead pixelcorrection, knee correction, etc., for frame images (for example, pixelsizes of images corresponding to a resolution of the pixel array 230)acquired by the camera module. The image post-processing unit of theimage processing module 710 may perform a color interpolation operationfor image-pre-processed sub frame images through a color interpolator,and perform noise cancellation, color correction, etc. for thecolor-interpolated sub frame images through an IPC, and convert RGB datainto YUV (or luminance-chroma_blue-chroma_red (YCbCr)) data through acolor converter.

The image processing module 710 may encode image-processed frame images.The image processing module 710 may scale an image (for example, a fullsize image of the pixel array 230) generated in the camera module, andgenerate the image as a preview image (or a live image). Also, based onthe processed image, the image processing module 710 may control (forexample, AF, AE, AWB, IPC, face detection, object tracking, etc.) thecamera module including the image sensor and/or the image processingmodule 710.

An image storing module 740 may store, in a memory, an image that isprocessed (for example, captured) in the image processing module 710.The image stored in the memory may be an encoded image or a non-encodedimage.

A motion estimating module 720 may estimate a subject motion within animage that is outputted from the image processing module 710. Theestimating of the subject motion may be conducted in various methods.First, the method of estimating the subject motion within the image mayanalyze continuous images to allocate a velocity vector to each pixel orregion, and sense a group of pixels or regions having similar velocityvectors to estimate operation information about a moving subject. Forexample, the motion estimating module 720 may use a method of extractinga velocity vector from a point-to-point corresponding relationship, amethod of tracking a moving subject based on features extracted fromcontinuous 1^(st) image (for example, a previous-frame image) and 2^(nd)image (for example, a current-frame image), a method of tracking amoving subject by attempting matching between candidate regions usingregion information, a method of tracking a moving subject by measuringan optical flow using a restriction condition that a velocity vectorchange of each pixel within an image is gentle, etc. Second, the methodof estimating the subject motion within the image may estimate themotion of the subject by analyzing difference images that are formed bya difference of gray-values between adjacent images. For example, themotion estimating module 720 may use a method of isolating a standstillregion and an action region using a difference of gray-values betweenadjacent images, a method of merging a differential operation result andan edge operation result to detect action information of an object, amethod of using a differential operation and an adaptive predictor, etc.

In an embodiment, the motion estimating module 720 of the electronicdevice may estimate a motion of a subject included in an image based onan optical flow scheme.

A device motion detecting module 760 may analyze an output of a sensormodule (for example, the sensor module 130 of FIG. 1 ), to detect amotion of the device. The device motion detecting module 760 may analyzean output of an acceleration sensor and/or a gyro sensor of the sensormodule 130, to analyze a motion of the electronic device.

When a user takes a photo, the user may move the electronic device whilephotographing. For example, the user may take a panorama shot, a tiltingshot, a zooming shot, etc., and also may move the electronic devicewhile photographing as in a running car. The panorama shot may be amethod of moving the electronic device horizontally in the direction of360 degrees while photographing. The tilting shot may be a method oftilting the electronic device up and down while photographing. Thezooming shot may be a photographing method of zooming in and out a lensso as to contain a subject in one camera angle or exactly express a lookor important appearance of a subject that is far away. The movementphotographing may be a method of moving the electronic device mounted ina transportation means (for example, a car, a bicycle, a drone, a cart,etc.) while photographing.

The user may move the electronic device while performing variousphotographing actions. The device motion detecting module 760 mayanalyze an output of an acceleration sensor and/or a gyro sensor of asensor module, to detect a horizontal motion, a vertical motion, arotation motion, etc. of the electronic device in a user-devicephotographing mode. If a motion of the device is detected in theuser-device photographing mode, the device motion detecting module 760may generate an image capture request signal.

An emotion recognizing module 770 may analyze an acquired feature of asubject, to recognize an emotion change of the subject. The subject maybe persons, pets, etc. The emotion recognition may be one of the mostimportant factors of a human-to-machine interface. An emotionrecognition technology may extract a feature mainly using a face image,a voice and/or a bio signal and classify this into each emotion categorythrough a previously learned recognition model. The emotion recognizingmodule 770 according to various embodiments of the present disclosuremay analyze a face image of a subject, to recognize the emotion (forexample, anger, happiness, sadness, fear, grief, surprise, etc.) of thesubject.

An emotion recognition method using a face image of a subject may be amethod of sensing a facial look of a user and a motion of the human bodyin an image (i.e., a still image or a video) and according to this,figuring out an emotion state of the user. A method of recognizing thefacial look may use an image based recognition method of directlyclassifying an emotion from a face image, or a model based recognitionmethod of mapping a face image to a facial muscle action. The imagebased recognition method may be a method of recognizing the facial lookusing a brightness value of the whole face image. The model basedrecognition method may be a method of detecting a feature in a faceimage, and figuring out a facial muscle action to recognize the faciallook.

The emotion recognizing module 770 according to various embodiments ofthe present disclosure may use the image based recognition method. Forexample, the emotion recognizing module 770 may use an emotionrecognition method being based on the Adaboost algorithm (facial lookrecognition by Adaboost).

The emotion recognizing module 770 may detect and extract a face portionfrom an acquired image, and may perform a pre-processing operation (forexample, re-sizing, histogram equalization, etc.) for recognizing anemotion using the extracted face image. Thereafter, the emotionrecognizing module 770 may execute the Adaboost algorithm for thepre-processed face image, to recognize the emotion. The Adaboostalgorithm may include various types of emotion classifiers (for example,a neutral strong classifier, a happy strong classifier, a sad strongclassifier, an angry strong classifier, a surprise strong classifier,etc.). The Adaboost algorithm may output a high value amongcorresponding emotion values for a face image of a learned look.

According to an embodiment, the emotion recognizing module 770 maydetect a position and size of a face from an image by the Adaboostalgorithm, and may obtain an output value by look from the detected faceimage, using the Adaboost strong classifier that is learned on aper-look basis. The emotion recognizing module 770 may set, as arecognized emotion, an emotion corresponding to the highest value amongthe output values of the Adaboost strong classifier. The emotionrecognizing module 770 may extract a face image to recognize the emotionof the user. If the recognized emotion is changed, the emotionrecognizing module 770 may generate a signal for automaticphotographing. For example, the emotion recognizing module 770 mayanalyze the output value of the Adaboost strong classifier, to recognizethe emotion of the user. If a change of the emotion (for example, achange from neutral to happy, a change from happy to sad, a change fromhappy to surprise, etc.) is recognized, the emotion recognizing module770 may generate an image capture request signal. Also, if a specificemotion is recognized (for example, happy), the emotion recognizingmodule 770 may generate an image capture request signal.

An image controlling module 730 may perform a photographing mode that isselected by a user. The photographing mode may include a user-devicephotographing mode. The user-device photographing mode may represent aphotographing mode of capturing an image generated in a camera module inresponse to a user's capture request, and automatically capturing animage generated in the camera module if a set condition is recognized inthe electronic device. If the user-device photographing mode isselected, the image controlling module 730 may drive the camera module,and may display a preview image generated in the image processing module710 on a display through a display processing module 750. Also, theimage controlling module 730 may display, on the display, aphotographing button by which the user may generate a capture signal inthe user-device photographing mode. Also, if the user-devicephotographing mode is set, the image controlling module 730 may enableat least one module among the motion estimating module 720, the devicemotion detecting module 760 and/or the emotion recognizing module 770.

If the user-device photographing mode is selected, the image controllingmodule 730 may analyze the motion estimating module 720, the devicemotion detecting module 760, the emotion recognizing module 770, and aninput of the photographing button. If the input of the photographingbutton is recognized or an image capture request signal is generated inthe motion estimating module 720, the device motion detecting module 760or the emotion recognizing module 770, the image controlling module 730may enable the image storing module 740 to store an image processed inthe image processing module 710 in a memory.

Also, if an image capture request signal is generated in the motionestimating module 720, the device motion detecting module 760 or theemotion recognizing module 770, the image controlling module 730 maycontrol the camera module to change a photographing interval time and/oran exposure time. In an embodiment, the image controlling module 730 mayset the photographing interval time of the camera module faster, and setthe exposure time shorter. In an embodiment, if a motion of a subject isdetected, the image controlling module 730 may control to automaticallycapture an image. Also, when capturing the image based on the motiondetection, the image controlling module 730 may control to change thephotographing interval time and/or exposure time of the camera module tobe short and capture the image within a fast time. The image controllingmodule 730 may control the image storing module 740 to store thecaptured image in the memory.

The display processing module 750 may display a preview image and/orcaptured images on the display in the user-device photographing mode.The display processing module 750 may display the preview image and/orthe captured images in various forms in accordance with the type of thedisplay. For example, the display may be constructed as a single displayor a multi-display (hereinafter, a ‘dual display’ is described as anexample). If the display is the single display, the display processingmodule 750 may display a preview image as in FIG. 5A, and may displaythe preview image and thumbnail images of captured images together as inFIG. 5B, and may display only the thumbnail images of the capturedimages as in FIG. 5C. If the display is the dual display, the displayprocessing module 750 may display thumbnail images of captured images onthe 1^(st) display and display a preview image on the 2^(nd) display asin FIG. 6A.

When displaying the captured images on the display, the displayprocessing module 750 may distinguish and display an image manuallycaptured by a user's selection and an image captured by the automaticphotographing of the electronic device. In an embodiment, the displayprocessing module 750 may add and display an icon image on the imagemanually captured by the user's selection, and may add and display eachmutually different image on each image captured by a user and theelectronic device, and may add and display an icon image on an imageautomatically captured by the electronic device.

According to various embodiments of the present disclosure, if a user'sphotographing request signal is recognized, the electronic device maycapture an image generated in the camera module and store the capturedimage in the memory. Also, if the motion estimating module 720 estimatesa subject motion within an image, or the device motion detecting module760 detects a motion of the electronic device, or the emotionrecognizing module 770 recognizes an emotion change of a subject (e.g.,person), the electronic device may capture an image outputted from thecamera module and store the captured image in the memory.

The motion estimating module 720 may estimate a motion of a subject inthe same method as that of the motion estimating module 320 of FIG. 3 .If the motion estimating module 720 detects a subject motion within animage, the motion estimating module 720 may generate an image capturerequest signal. The device motion detecting module 760 may detect amotion of the electronic device according to an operation of moving theelectronic device while photographing (e.g., a panorama shot, a tiltingshot, a moving shot, etc.). If the motion of the electronic device isdetected, the device motion detecting module 760 may generate an imagecapture request signal. The emotion recognizing module 770 may analyze asubject within an image, to recognize an emotion change or a specificemotion state. If the specific emotion state or the emotion change isrecognized, the emotion recognizing module 770 may generate an imagecapture request signal.

If a selection of a photographing button is recognized, the imagecontrolling module 730 may set the camera module to a 1^(st)photographing condition. If an image capture request signal is generatedin the motion estimating module 720, the image controlling module 730may set the camera module to a 2^(nd) photographing condition. The2^(nd) photographing condition may be set variably based on a movementspeed of a recognized subject. Also, the 2^(nd) photographing conditionmay be set as a fixed value. If an image capture request signal isgenerated in the device motion detecting module 760, the imagecontrolling module 730 may set the camera module to a 3^(rd)photographing condition. The 3^(rd) photographing condition may be setvariably based on a movement speed of the electronic device. Also, the3^(rd) photographing condition may be set as a fixed value. If an imagecapture request signal is generated in the emotion recognizing module770, the image controlling module 730 may set the camera module 120 to a4^(th) photographing condition. The 4^(th) photographing condition maybe set variably based on a recognized emotion change speed. Also, the4^(th) photographing condition may be set as a fixed value.

The 2^(nd) photographing condition to the 4^(th) photographing conditionmay have mutually different time values (i.e., photographing time and/orexposure time), or may have the same time value. The 2^(nd)photographing condition to the 4^(th) photographing condition may haverelatively faster photographing interval time and/or shorter exposuretime, compared to the 1^(st) photographing condition. The imagecontrolling module 730 may set a photographing condition, based on acombination of at least two of the 1^(st) photographing condition to the4^(th) photographing condition.

If an image capture request signal is generated in the motion estimatingmodule 720, the device motion detecting module 760 or the emotionrecognizing module 770, the image controlling module 730 may control thecamera module based on a set condition, and control to capture an imageprocessed in the image processing module 710 and store the capturedimage in the memory.

The image controlling module 730 may analyze automatically photographedimages and store the optimal number of images. For the sake of this, theimage controlling module 730 may analyze captured images, to groupimages having similar motions. The image controlling module 730 mayfilter the grouped images, to select images. For example, the imagecontrolling module 730 may eliminate blur images, too dark or brightimages, and/or images not including a part of a subject (for example,images in which the subject deviates from a camera angle) among thegrouped images. The image controlling module 730 may select images inwhich motions are not repeated among the filtered images. Also, theimage controlling module 730 may display the filtered images assuggestion images on a display through the display processing module750, and may store images manually selected by a user. When a screen ofthe display is refreshed, the image controlling module 730 may storeonly the set number of images (for example, one suggestion image) perimage group through the image storing module 740, and eliminate theremnant from a buffer (for example, an internal buffer or the processor100 or a specific region of the memory 110).

An electronic device according to various embodiments of the presentdisclosure may include a camera, a display, a processor electricallycoupled with the camera and the display, and a memory electricallycoupled with the processor. The memory may be configured to storeinstructions which, when executed, instruct the processor to, when aphotographing request signal is received, estimate a motion of a subjectwithin an image that is acquired by the camera, when the motion of thesubject within the image acquired by the camera is not recognized,control the camera to capture a 1^(st) type image by applying a 1^(st)photographing condition, and when the motion of the subject within theimage acquired by the camera is recognized, control the camera tocapture a 2^(nd) type image by applying a 2^(nd) photographingcondition.

According to various embodiments, the 1^(st) and 2^(nd) photographingconditions may include at least one of a photographing interval time oran exposure time, and the 2^(nd) photographing condition may have atleast one of a shorter interval time or exposure time than the 1^(st)photographing condition.

According to various embodiments, the device may further include asensor configured to detect a motion of the electronic device, and theinstructions may further instruct the processor to, when the motion ofthe electronic device is detected through the sensor, control the camerato capture a 3^(rd) type image by applying a 3^(rd) photographingcondition.

According to various embodiments, the instructions may further instructthe processor to, when an emotion change of the subject within thephotographed image is recognized, control the camera to capture a 4^(th)type image by applying a 4^(th) photographing condition.

According to various embodiments, the instructions may instruct theprocessor to group images that are similar among the captured images,filter the grouped images to suggest suggestion images comprising a setnumber of images, and store the captured images and the suggestionimages.

According to various embodiments, the filtered images may include blurimages.

According to various embodiments, the instructions may further instructthe processor to display a preview image in a photographing mode, andbased on a user's input, display the preview image in a 1^(st) area ofthe display and display thumbnail images of captured images in a 2^(nd)area of the display.

According to various embodiments, the 2^(nd) area may be an edge area ofthe display.

According to various embodiments, the instructions may further instructthe processor to, based on a user's input, display the thumbnail imagesof the captured images on the display, and distinguish and displayimages captured by one of a user's selection or the electronic device.

FIG. 8 is a flowchart illustrating an operation of photographing animage in an electronic device according to an embodiment of the presentdisclosure. FIG. 8 may be a flowchart illustrating an operation in whichthe electronic device automatically photographs when a motion of asubject is detected.

Referring to FIG. 8 , a user may select a user-device photographingfunction from a photographing menu. If the user-device photographingfunction (mode) is selected, in operation 811, the electronic device(for example, the processor 100 of FIG. 1 ) may execute the user-devicephotographing function. For example, the electronic device may drive acamera module (for example, the camera module 120 of FIG. 1 ) and enablea module estimating a motion of a subject (for example, the motionestimating module 320 of FIG. 3 and/or the motion estimating module 720of FIG. 7 ). In operation 813, the electronic device may process animage outputted from the camera module, to display a preview image on adisplay (for example, the display 150 of FIG. 1 ). The electronic devicemay display a photographing button on the display.

When an input of the photographing button or a motion of a subject isdetected, the electronic device may capture an image outputted from thecamera module. According to an embodiment, the electronic device mayestimate the motion of the subject based on an optical flow method. Ifthe motion of the subject is recognized, i.e., YES in operation 815, theelectronic device may recognize this and, in operation 817, theelectronic device may set a condition (i.e., a 2^(nd) photographingcondition) for automatically photographing in the electronic device. Ina case where the motion of the subject is generated, the electronicdevice may require a fast photographing operation. In operation 817, theelectronic device may set a photographing interval time and/or anexposure time period short. If the photographing condition is set, inoperation 819, the electronic device may capture an image at a fastinterval time through the camera module. For example, if the motion ofthe subject is recognized, the electronic device may capture an image ina method such as a burst shot while the motion of the subject isdetected.

If the motion of the subject is not recognized, i.e., NO in operation815, and the user selects a photographing button, i.e., YES in operation821, the electronic device may recognize this and, in operation 823, theelectronic device may set a 1^(st) photographing condition according tothe user's selection. When performing a photographing operationaccording to the user's selection, the electronic device may perform anautomatic photographing mode, or a manual photographing mode in which aphotographing condition is set by the user. In case where the mode isthe automatic photographing mode, the electronic device may set thephotographing condition in accordance with a photographing environment.In case where the mode is the manual photographing mode, the electronicdevice may manually capture an image on the 1^(st) photographingcondition that is set by the user. After the electronic device sets the1^(st) photographing condition, in operation 825, the electronic devicemay manually capture (acquire) an image in accordance with the set1^(st) photographing condition.

If the photographing button is selected, the electronic device mayacquire an image outputted from the camera module at a correspondingtime point. If the motion of the subject is recognized, the electronicdevice may automatically acquire an image while the motion of thesubject is detected. Accordingly, the electronic device may acquire animage if the user's selection or the motion of the subject is recognizedin the user-device photographing mode.

If the user terminates the user-device photographing mode in process ofperforming the user-device photographing mode, in operation 827, theelectronic device may recognize this, and stop the driving of the cameramodule and terminate the photographing operation. In contrast, if theuser-device photographing mode is not terminated, the electronic devicemay return to operation 813 and repeat the aforementioned operations. Ifthe motion of the subject is not recognized, i.e., NO at operation 815,and the user does not select the photographing button, i.e., NO inoperation 821, the electronic device determines whether the userterminates the user-device photographing mode, in operation 827.

FIG. 9 is a flowchart illustrating an operation of processing a capturedimage in an electronic device according to an embodiment of the presentdisclosure. FIG. 9 may be an operation of capturing an image that isacquired in accordance with a user's selection or a motion of a subject.

Referring to FIG. 9 , the electronic device may capture many images ifautomatically performing a photographing operation while a motion of asubject is detected. When storing an image, the electronic deviceaccording to various embodiments of the present disclosure may analyzethe captured images, to store the optimal number of images.

In operation 911, the electronic device may group images having similarsubject motions, and display the grouped images on a display (forexample, the display 150 of FIG. 1 ). After grouping the images, inoperation 913, the electronic device may filter the grouped images. Theimage filtering may be an operation of selecting a photo that satisfiesa proper condition or eliminating images not satisfying the propercondition. For example, the electronic device may eliminate at least oneof blur images, images that are too dark, or images that are too bright.

After performing the image filtering operation, in operation 915, theelectronic device may select images to be stored. The electronic devicemay suggest and display the set number of images (for example, oneimage) per image group. If the image is selected, in operation 917, theelectronic device may store the selected image in a memory (for example,the memory 110 of FIG. 1 ). The electronic device may eliminate theremnant images excepting the image suggested or selected from the imagegroup.

In an embodiment, the electronic device may analyze images automaticallycaptured by the motion of the subject, to group similar images, andstore a suggested or selected image among the grouped images andeliminate the remnant images.

FIG. 10 is a flowchart illustrating an operation of displaying aphotographed image in an electronic device according to an embodiment ofthe present disclosure. FIG. 10 illustrates an example of a case inwhich a display of the electronic device is a single display.

Referring to FIG. 10 , the electronic device may display images that areacquired in a user-device photographing mode, on the display. Inoperation 1011, the electronic device may display a preview image. Thepreview image displayed in operation 1011 may be a state in which theelectronic device displays a screen as illustrated in FIG. 5A or FIG.5F. In a state in which the preview image is displayed, a user maygenerate an input for displaying a thumbnail image and a preview imagetogether. In a state of displaying a preview screen, if an input is notgenerated, i.e., NO in operation 1013, the process returns to operation1011. Alternatively, in a state of displaying a preview screen, if aninput (for example, the 1^(st) input 510 of FIG. 5B) by which the userselects 1^(st) displaying is generated, i.e., YES in operation 1013, theelectronic device may recognize this and, in operation 1015, theelectronic device may display a 1^(st) display screen on the display. Asin FIG. 5B, the 1^(st) display screen may display a preview image in the1^(st) area 520 and display thumbnail images of captured images in the2^(nd) area 530. The thumbnail images may be displayed in an edge areaof the display.

In a state of displaying the 1^(st) display screen of FIG. 5B, if aninput (for example, the 4^(th) input 575 of FIG. 5E) by which the userselects preview image displaying is generated, i.e., YES in operation1017, the electronic device may recognize this, and return to operation1011 and display the preview image on the display, as in FIG. 5F. In astate of displaying the preview image and the thumbnail images of thecaptured images, the electronic device may convert into a screen ofdisplaying the preview image by a user's selection.

On the other hand, in a state of displaying the 1^(st) display screen ofFIG. 5B, if the user does not select preview image displaying, i.e., NOin operation 1017, and an input (for example, the 2^(nd) input 515 ofFIG. 5C) by which the user selects 2nd displaying is generated, i.e.,YES in operation 1019, the electronic device may recognize this and, inoperation 1021, the electronic device may display a 2^(nd) displayscreen on the display. If the user does not select preview imagedisplaying, i.e., NO in operation 1017, and the 2^(nd) input is notgenerated, i.e., NO in operation 1019, the electronic device mayrecognize this and return to operation 1015. The 2^(nd) display screenmay display thumbnail images of captured images on the display, as inFIG. 5C. When the electronic device displays the thumbnail images, theelectronic device may, as illustrated in FIG. 5C, display the latestthumbnail image manually captured by a user's selection in the 1^(st)specific area 540 of the display, and display the latest thumbnail imageautomatically captured by a motion of a subject in the 2^(nd) specificarea 550 of the display, and may display the thumbnail images of theimages captured by the user's selection and/or the electronic device inthe 3^(rd) specific area 560 of the display.

Also, when the electronic device displays the thumbnail images of the2^(nd) display screen on the display, the electronic device maydistinguish and display an image manually captured by a user's selectionor images automatically captured by the electronic device. FIG. 5Cillustrates an example of adding and displaying an icon image on animage manually selected by a user, and not displaying an icon image onan image automatically captured by the electronic device. The electronicdevice may add and display a 1^(st) icon image on the image manuallyselected by the user, and may display a 2^(nd) icon image distinguishedfrom the 1^(st) icon image on the image automatically captured by theelectronic device. Also, the electronic device may display an icon imageon the image automatically captured by the electronic device, and maynot display an icon image on the image manually selected by the user.

In a state of displaying the 2^(nd) display screen, if the 3^(rd) input570 is sensed, as in FIG. 5D, i.e., YES in operation 1023, theelectronic device may recognize this, and return to operation 1015 anddisplay the 1^(st) display screen on the display, as in FIG. 5E. In astate of displaying the 2^(nd) display screen, if the 3^(rd) input isnot sensed, i.e., NO at operation 1023, the electronic device mayrecognize this, and return to operation 1021.

In accordance with a user's selection, the electronic device may displayonly a preview image, display the preview image and thumbnail images ofcaptured images together, or display only the thumbnail images of thecaptured images. And, if the user ends the photographing, the electronicdevice may terminate the operation of displaying the image of FIG. 10 .

The display of the electronic device may be a dual display. In casewhere the display is the dual display, the electronic device may displaya preview image on a 1^(st) display of the dual display, and display athumbnail image of a captured image on a 2^(nd) display.

FIG. 11 is a flowchart illustrating an operation of photographing animage in an electronic device according to an embodiment of the presentdisclosure. FIG. 11 may be a flowchart illustrating an operation inwhich the electronic device automatically photographs if a motion of asubject or a motion of the device is detected.

Referring to FIG. 11 , a user may select a user-device photographingfunction from a photographing menu. If the user-device photographingfunction (mode) is selected, in operation 1111, the electronic device(for example, the processor 100 of FIG. 1 ) may execute the user-devicephotographing function. For example, the electronic device may drive acamera module (for example, the camera module 120 of FIG. 1 ) and enablea module estimating a motion of a subject (for example, the motionestimating module 320 of FIG. 3 and/or the motion estimating module 720of FIG. 7 ) and a module detecting a motion of the electronic device(for example, the device motion detecting module 760 of FIG. 7 ). Inoperation 1113, the electronic device may process an image outputtedfrom the camera module, to display a preview image on a display (forexample, the display 150 of FIG. 1 ). The electronic device may displaya photographing button on the display. According to an embodiment, inoperation 1113, the electronic device may display the preview image onthe display in the method of FIG. 10 in accordance with a user'sselection.

In operation 1115, the electronic device may estimate if there is asubject motion within an image. For example, the electronic device maycompare a plurality of continuous frame images to estimate the subjectmotion within the image. If the motion of the subject is recognized,i.e., YES in operation 1115, the electronic device may recognize thisand, in operation 1117, the electronic device may set a 2^(nd)photographing condition for automatically capturing an image. If themotion of the subject is recognized, the electronic device may set the2^(nd) photographing condition having a shorter photographing intervaltime and/or exposure time than a 1^(st) photographing condition. Thephotographing interval time and/or exposure time of the 2^(nd)photographing condition may be variably set according to a velocity atwhich the subject moves, or may be set as a fixed value irrespective ofthe movement velocity of the subject. After setting the 2^(nd)photographing condition, in operation 1119, the electronic device maycontrol the camera module to automatically capture an image on the2^(nd) photographing condition.

If the motion of the subject is not recognized, i.e., NO in operation1115, the electronic device may, in operation 1121 detect if there is amotion of the electronic device. The electronic device may have modes ofmoving the electronic device while photographing. For example, the usermay move the electronic device in a horizontal or vertical directionwhile photographing. In this case, if a camera angle is changed, even acaptured image may become different. If the motion of the electronicdevice is detected, i.e., YES in operation 1121, the electronic devicemay recognize this and, in operation 1123, the electronic device may seta 3^(rd) photographing condition. The photographing interval time and/orexposure time of the 3^(rd) photographing condition may be variably setaccording to a movement velocity of the electronic device, or may be setas a fixed value irrespective of the movement velocity of the electronicdevice. After setting the 3^(rd) photographing condition, in operation1125, the electronic device may control the camera module toautomatically capture an image on the 3^(rd) photographing condition.

If the motion of the electronic device is not detected, i.e., NO inoperation 1121, and if the user selects a photographing button, i.e.,YES in operation 1127, the electronic device may recognize this and, inoperation 1129, the electronic device may set a 1^(st) photographingcondition according to the user's selection. When performing aphotographing operation according to the user's selection, theelectronic device may perform an automatic photographing mode, or amanual photographing mode in which a photographing condition is set bythe user. In case where it is the automatic photographing mode, theelectronic device may set the photographing condition in accordance witha photographing environment. In case where it is the manualphotographing mode, the electronic device may manually capture an imageon the 1^(st) photographing condition that is set by the user. Aftersetting the 1^(st) photographing condition, in operation 1131, theelectronic device may manually acquire an image on the set 1^(st)photographing condition.

If the photographing button is selected in operation 1127, theelectronic device may acquire an image outputted from the camera moduleat a corresponding time point. Also, if a motion of a subject isrecognized in operation 1115, the electronic device may set a 2^(nd)photographing condition, and if a motion of the electronic device isdetected in operation 1121, the electronic device may set a 3^(rd)photographing condition, and capture an image based on the set 2^(nd) or3^(rd) photographing condition. At this time, the 2^(nd) photographingcondition and the 3^(rd) photographing condition may be set to have amutually different photographing interval time and/or exposure timerespectively, or may be set to have the same photographing interval timeand/or exposure time.

If the user does not select a photographing button in operation 1127,i.e., NO in operation 1127, and if the user terminates the user-devicephotographing mode in process of performing the user-devicephotographing mode, i.e., YES in operation 1133, the electronic devicemay recognize this, and stop the driving of the camera module and endthe photographing operation. In contrast, if the photographing mode isnot terminated, i.e., NO in operation 1133, the electronic device mayreturn to operation 1113 and repeat the aforementioned operations.

FIG. 12 is a flowchart illustrating an operation of photographing animage in an electronic device according to an embodiment of the presentdisclosure. FIG. 12 may be a flowchart illustrating an operation inwhich the electronic device automatically photographs if a motion of asubject, a motion of the device or the emotion of the subject isdetected.

Referring to FIG. 12 , a user may select a user-device photographingfunction from a photographing menu. If the user-device photographingfunction is selected, in operation 1211, the electronic device (forexample, the processor 100 of FIG. 1 ) may execute the user-devicephotographing function. For example, the electronic device may drive acamera module (for example, the camera module 120 of FIG. 1 ) and enablea module estimating a motion of a subject (for example, the motionestimating module 320 of FIG. 3 and/or the motion estimating module 720of FIG. 7 ), a module detecting a motion of the electronic device (forexample, the device motion detecting module 760 of FIG. 7 ) and a modulerecognizing the emotion of the subject (for example, the emotionrecognizing module 770 of FIG. 7 ). In operation 1213, the electronicdevice may process an image outputted from the camera module, to displaya preview image on a display (for example, the display 150 of FIG. 1 ).The electronic device may display a photographing button on the display.According to an embodiment, in operation 1213, the electronic device maydisplay the preview image on the display in the method of FIG. 10 inaccordance with a user's selection.

In operation 1215, the electronic device may estimate if there is amotion of a subject within the image. For example, the electronic devicemay compare a plurality of continuous frame images, to estimate thesubject motion within the image. If the motion of the subject isrecognized, i.e., YES in operation 1215, the electronic device mayrecognize this and, in operation 1217, the electronic device may set a2^(nd) photographing condition for automatically capturing an image. Thephotographing interval time and/or exposure time of the 2^(nd)photographing condition may be variably set according to a velocity atwhich the subject moves, or may be set as a fixed value irrespective ofthe movement velocity of the subject. After setting the 2^(nd)photographing condition, in operation 1219, the electronic device maycontrol the camera module to automatically capture an image on the2^(nd) photographing condition.

If the motion of the subject is not recognized, i.e., NO in operation1215, in operation 1221, the electronic device may detect if there is amotion of the electronic device. For example, a user may move theelectronic device in a horizontal or vertical direction whilephotographing. If the motion of the electronic device is detected, i.e.,YES in operation 1221, the electronic device may recognize this and, inoperation 1223, the electronic device may set a 3^(rd) photographingcondition. The photographing interval time and/or exposure time of the3^(rd) photographing condition may be variably set according to amovement velocity of the electronic device, or may be set as a fixedvalue irrespective of the movement velocity of the electronic device.After setting the 3^(rd) photographing condition, in operation 1225, theelectronic device may control the camera module to automatically capturean image on the 3^(rd) photographing condition.

The subject may be a subject that is capable of expressing an emotionsuch as persons, pets, etc. If the subject motion is not recognized,i.e., NO in operation 1215 and the device motion is not detected, i.e.,NO in operation 1221, in operation 1227, the electronic device mayrecognize the emotion of the subject. If a change of the emotion isrecognized or a specific emotion (for example, happy, surprise, etc.) isrecognized, i.e., YES in operation 1227, the electronic device mayrecognize this and, in operation 1229, the electronic device may set a4^(th) photographing condition. The photographing interval time and/orexposure time of the 4^(th) photographing condition may be variably setaccording to a speed at which the emotion change of the subject isrecognized, or may be set as a fixed value irrespective of the emotionchange speed of the subject. After setting the 4^(th) photographingcondition, in operation 1231, the electronic device may control thecamera module to automatically capture an image on the 4^(th)photographing condition.

If the subject motion is not recognized, i.e., NO in operation 1215,device motion is not detected, i.e., NO in operation 1221, a change ofthe emotion or a specific motion is not recognized, i.e., NO inoperation 1227, and the user selects a photographing button, i.e., YESin operation 1233, the electronic device may recognize this and, inoperation 1235, the electronic device may set a 1^(st) photographingcondition according to the user's selection. When performing aphotographing operation according to the user's selection, theelectronic device may perform an automatic photographing mode, or amanual photographing mode in which a photographing condition is set bythe user. In case where it is the automatic photographing mode, theelectronic device may set the photographing condition in accordance witha photographing environment. In case where it is the manualphotographing mode, the electronic device may manually capture an imageon the 1^(st) photographing condition that is set by the user. Aftersetting the 1^(st) photographing condition, in operation 1237, theelectronic device may manually acquire an image on the set 1^(st)photographing condition.

If the photographing button is selected, i.e., YES in operation 1233,the electronic device may acquire an image outputted from the cameramodule at a corresponding time point. Also, if a motion of a subject isrecognized, the electronic device may set a 2^(nd) photographingcondition and if a motion of the electronic device is detected, theelectronic device may set a 3^(rd) photographing condition, and if theemotion change (or set emotion) of the subject is recognized, theelectronic device may set a 4^(th) photographing condition, to capturean image based on the set photographing condition. At this time, the2^(nd) photographing condition, the 3^(rd) photographing condition andthe 4^(th) photographing condition may be set to have a mutuallydifferent photographing interval time and exposure time respectively, ormay be set to have the same photographing interval time and/or exposuretime.

If the photographing button is not selected, i.e., NO in operation 1233,and the user terminates the user-device photographing mode in process ofperforming the user-device photographing mode, i.e., YES in operation1239, the electronic device may recognize this, and stop the driving ofthe camera module and end a photographing operation. In contrast, if thephotographing mode is not terminated, i.e., NO in operation 1239, theelectronic device may return to operation 1213 and repeat theaforementioned operations.

A method for operating in an electronic device according to variousembodiments of the present disclosure may include the operations of,when a photographing request signal is received, estimating a motion ofa subject within an image that is acquired in a camera, when the motionof the subject within the image acquired by the camera is notrecognized, controlling the camera to capture a 1^(st) image by applyinga 1^(st) photographing condition, and when the motion of the subjectwithin the image acquired by the camera is recognized, controlling thecamera to capture a 2^(nd) type image by applying a 2^(nd) photographingcondition.

According to various embodiments, the 1^(st) and 2^(nd) photographingconditions may include at least one of a photographing interval time oran exposure time, and the 2^(nd) photographing condition may have atleast one of a shorter interval time or exposure time than the 1^(st)photographing condition.

According to various embodiments, the operating method of the electronicdevice may further include the operations of: detecting a motion of theelectronic device, and when the motion of the electronic device isdetected, controlling the camera to capture a 3^(rd) type image byapplying a 3^(rd) photographing condition.

According to various embodiments, the operating method of the electronicdevice may further include the operations of recognizing an emotion ofthe subject within the image that is photographed by the camera, andwhen an emotion change of the subject is recognized, controlling thecamera to capture a 4^(th) type image by applying a 4^(th) photographingcondition.

According to various embodiments, the controlling of the camera tocapture the 2^(nd) type image may include the operations of groupingimages that are similar among the captured images, filtering the groupedimages, suggesting suggestion images comprising a set number of imagesof the filtered images, and storing the suggested images.

According to various embodiments, the filtering of the grouped imagesmay include the operation of filtering blur images.

According to various embodiments, the operating method of the electronicdevice may further include the operations of displaying a preview imageon a display, and based on a user's input, displaying the preview imagein a 1^(st) area of the display and displaying thumbnail images of thecaptured images in a 2^(nd) area of the display.

According to various embodiments, the 2^(nd) area may be an edge area ofthe display.

According to various embodiments, the operating method of the electronicdevice may further include the operation of based on a user's input,displaying the thumbnail images of the captured images on the display ina photographing mode. The thumbnail images displayed on the display maybe images that are captured by one of a user's selection or theelectronic device and are distinguished and displayed.

According to various embodiments, an electronic device including animage sensor may perform a man-machine photographing or superimposedmachine capture operation that is capable of photographing an imagebased on a user's selection and a photographing state recognition of thedevice. When the electronic device performs the photographing operation,the electronic device may detect (or recognize) a motion of a subject, amotion of the device, an emotion change of a subject (e.g., person),etc., and set, as a photographing condition, a state in which the motionof the subject, the motion of the device and/or the emotion change aredetected. The electronic device may perform an automatic photographingoperation based on the set photographing condition in a process ofphotographing, so the electronic device may automatically capture asubject image that a user may miss.

What is claimed is:
 1. An electronic device comprising: a camera; adisplay; a processor operatively coupled with the camera and thedisplay; and a memory operatively coupled with the processor, whereinthe memory is configured to store instructions which, when executed,cause the processor to: execute a photographing function of theelectronic device; in response to the photographing function beingexecuted, display, on the display, a preview image that is currentlybeing acquired by the camera of the electronic device; determine whethera motion of the electronic device is detected; in response to the motionof the electronic device being not detected, execute an automaticphotographing mode, according to a predefined condition; andautomatically photograph the subject in the automatic photographingmode.
 2. The electronic device of claim 1, wherein the instructionsfurther instruct the processor to: in response to the photographingfunction being executed, activate a function for detecting the motion ofthe electronic device.
 3. The electronic device of claim 1, wherein theinstructions further instruct the processor to detect at least one of ahorizontal movement, a vertical movement or a rotation movement of theelectronic device, by using at least one of an acceleration sensor or agyro sensor.
 4. The electronic device of claim 1, wherein aphotographing condition for the autographing photographing is set inaccordance with a photographing environment of the electronic device, inthe automatic photographing mode.
 5. The electronic device of claim 1,wherein the instructions further instruct the processor to: determinewhether a motion of the subject is detected, and photograph the subjectin the automatic photographing mode in response to the motion of thesubject being not detected.
 6. The electronic device of claim 5, whereinthe instructions further instruct the processor to: photograph thesubject according to a photographing condition related to the motion ofthe subject being not detected.
 7. The electronic device of claim 6,wherein the photographing condition related to the motion of the subjectbeing not detected is different from a photographing condition relatedto the motion of the subject being detected.
 8. The electronic device ofclaim 1, wherein the photographing condition related to the motion ofthe subject being not detected comprises at least one of a photographinginterval time or an exposure time.
 9. The electronic device of claim 1,wherein the instructions further instruct the processor to: determinewhether an emotion change of the subject is recognized, and photographthe subject in the automatic photographing mode in response to theemotion change of the subject being detected.
 10. The electronic deviceof claim 9, wherein the instructions further instruct the processor to:photograph the subject according to a photographing condition related tothe emotion change of the subject.
 11. A method for photographing asubject, the method performed by an electronic device and comprising:executing a photographing function of the electronic device; in responseto the photographing function being executed, displaying a preview imagethat is currently being acquired by a camera of the electronic device;determining whether a motion of the electronic device is detected; inresponse to the motion of the electronic device being not detected,performing an automatic photographing mode, according to a predefinedcondition; and automatically photographing the subject in the automaticphotographing mode.
 12. The method of claim 11, the method furthercomprising: in response to the photographing function being executed,activating a function for detecting the motion of the electronic device.13. The method of claim 11, the determining whether a motion of theelectronic device is detected comprising: the detecting at least one ofa horizontal movement, a vertical movement or a rotation movement of theelectronic device, by using at least one of an acceleration sensor or agyro sensor.
 14. The method of claim 11, wherein a photographingcondition for the autographing photographing is set in accordance with aphotographing environment of the electronic device, in the automaticphotographing mode.
 15. The method of claim 11, the method furthercomprising: determining whether a motion of the subject is detected, andwherein the automatically photographing the subject comprisesphotographing the subject in the automatic photographing mode inresponse to the motion of the subject being not detected.
 16. The methodof claim 15, wherein the automatically photographing the subjectcomprises photographing the subject according to a photographingcondition related to the motion of the subject being not detected. 17.The method of claim 16, wherein the photographing condition related tothe motion of the subject being not detected is different from aphotographing condition related to the motion of the subject beingdetected.
 18. The method of claim 11, wherein the photographingcondition related to the motion of the subject being not detectedcomprises at least one of a photographing interval time or an exposuretime.
 19. The method of claim 11, wherein the method further comprising:determining whether an emotion change of the subject is recognized, andwherein the automatically photographing the subject comprisesphotographing the subject in the automatic photographing mode inresponse to the emotion change of the subject being detected.
 20. Themethod of claim 19, wherein the automatically photographing the subjectcomprises photographing the subject according to a photographingcondition related to the emotion change of the subject.